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SOLVING TWO-POINT BOUNDARY VALUE PROBLEMS FOR A WAVE EQUATION VIA 
THE PRINCIPLE OF STATIONARY ACTION AND OPTIMAL CONTROL * 

PETER M. DOWERt AND WILLIAM M. MCENEANEY* 


Abstract. A new approach to solving two-point boundary value problems for a wave equation is developed. This 
new approach exploits the principle of stationary action to reformulate and solve such problems in the framework of 
optimal control. In particular, an infinite dimensional optimal control problem is posed so that the wave equation 
dynamics and temporal boundary data of interest are captured via the characteristics of the associated Hamiltonian and 
choice of terminal payoff respectively. In order to solve this optimal control problem for any such terminal payoff, and 
hence solve any two-point boundary value problem corresponding to the boundary data encapsulated by that terminal 
payoff, a fundamental solution to the optimal control problem is constructed. Specifically, the optimal control problem 
corresponding to any given terminal payoff can be solved via a max-plus convolution of this fundamental solution with 
the specified terminal payoff. Crucially, the fundamental solution is shown to be a quadratic functional that is defined 
with respect to the unique solution of a set of operator differential equations, and computable using spectral methods. 
An example is presented in which this fundamental solution is computed and applied to solve a two-point boundary 
value problem for the wave equation of interest. 
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1. Introduction. The principle of stationary action, or action principle, states that any trajectory gen¬ 
erated by a conservative system must render the corresponding action functional stationary in the calculus of 
variations sense, see for example nni im HD- As this action functional is defined as the time integral of the 
associated Lagrangian, it may be regarded as the payoff due to a unique trajectory generated by some gen¬ 
eralized system dynamics, and corresponding to a specified initial system state. By regarding the velocity of 
these generalized dynamics as an input, the action principle may be expressed as an optimal control problem. 
Recent work by the authors has exploited this correspondence with optimal control to develop a fundamental 
solution to the classical gravitational iV-body problem, see [T5l[T6]. This fundamental solution is a special case 
of a more general notion of a fundamental solution semigroup developed for optimal control problems, see for 
example [HlTlEolIH]. In the specific case of the gravitational iV-body problem, by constructing a fundamental 
solution to the optimal control problem corresponding to stationary action, a fundamental solution to a class 
of A-body two-point boundary value problems (TPBVPs) may also be constructed. In this paper, the corre¬ 
sponding fundamental solution construction for a class of TPBVPs is extended via infinite dimensional systems 
theory to a wave equation [niEiiiiisiiiiiT]. The specific wave equation considered is expressed via the partial 
differential equation (PDE) and boundary data 


d'^u f 

ds^ \m) dX^ 


u(-, 0) = 0 = u(-, L), L G ]R>o . 


( 1 . 1 ) 


In a mechanical setting (for example), u{s,X) may be interpreted as the displacement of a vibrating string at 
time s G [0,t|, t G M>o, and location A G A, A = (0, L). Here, constants k,to G K>o model the distributed 
elastic spring constant and mass respectively (with SI units of N and kgm~^). An example pair of initial and 
terminal conditions defining a TPBVP of interest is 


u(0, •) = x {-), u{t,-) = z {-), 


( 1 . 2 ) 


in which x and z denote the initial and terminal displacements. The problem to solve is then 


{ Find the initial velocity ^(0, •) 

(if it exists) such that (11.11) and (11.21) 
hold with functions x and z given. 


(1.3) 
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(Another example of a TPBVP of interest is to determine the initial velocity such that a desired terminal 
velocity is attained.) In order to formulate the action principle for system (EU, note that the potential and 
kinetic energies associated with a solution u{s, ■) of (EH) at time s G [0, t] are respectively denoted by V{u{s, •)) 
and T(^(s, •)), where V and T are the functionals defined by 


r 

du, 

2 

f du , ,\ f 

du, 

f / 

JA 


dX, 

us<»->)=-A 



d\. 


The action principle states that any solution u of EH must render the action functional 

^ P(u(s,-))-T ds 


(1.4) 


(1.5) 


stationary in the sense of the calculus of variations [T^, where V and T denote the energy functionals as per 
EH, and the integrand is the Lagrangian or its additive inverse (as selected here). This includes any solution of 
the TPBVP (11.31) . Hence, by formulating an appropriate optimal control problem encapsulating this variational 
problem, solutions of the TPBVP E3D may be investigated. In particular, a fundamental solution to the 
TPBVP (11.31) can be constructed within the framework of infinite dimensional optimal control, using a more 
general notion of fundamental solution semigroup for optimal control [Ml (3 [201 HI- The attendant optimal 
control problem and subsequent TPBVP fundamental solution is formulated and developed in Sections [21 and IH 
Useful auxiliary optimal control problems, and their interrelationships, are employed in this development. The 
application of this fundamental solution is then considered in the context of an illustrative example in Section 
m Selected technical details of relevance to the development are included in the appendices. 

In terms of the notation, R, ]R>o, and ]R>o denotes the sets of reals, non-negative reals, and positive reals 
respectively. Given an open subset D of a Euclidean space and a Banach space the respective spaces of 
continuous, continuously differentiable, and Lebesgue square integrable functions mapping D to ^ are denoted 
by (^(D; S’), C'^(]D);S’), and ^2(0; S’). Symbols d and 9^ denote first and second order differentation for 
functions defined on A. An operator O : S'—between Banach spaces S' and is Frechet differentiable at 
X G S' if there exists a bounded linear operator dO{x) G £(S’; ^V) such that the limit lim||/i||^_>o \\0{x + h) — 
0{x) — dO{x)h\\, 3 r/\\h\\sc exists and is zero. 

2. Approximating stationary action via optimal control. Where the action functional is concave 
or convex, the action principle can be formulated as an optimal control problem, see for example |151 US]. 
However, this convexity or concavity, corresponding to that of the payoff or cost functional, is limited to a finite 
time horizon that is determined by parameters associated with the kinetic and potential energies. In the finite 
dimensional case, this limited time horizon is strictly positive, so that the conservative dynamics defined by the 
action principle can be propagated via solution of the optimal control problem up to that time horizon. However, 
in the infinite dimensional case considered here, this limited time horizon tends to zero, see Theorem l2.1l and |S|, 
thereby complicating the direct application of the approach of [ISKISj. In order to overcome this complication, a 
perturbed optimal control problem is formulated that approximates the stationary action principle on a strictly 
positive time horizon, thereby allowing the solution of the TPBVP EH to be approximated on that time 
horizon. By concatenating such horizons via the dynamic programming principle, solutions on longer horizons 
can also be approximated. Such approximations are shown (using well-known semigroup approximation results) 
to be exact in the limit of vanishing perturbations, see Section |4| 

2.1. Preliminaries. Define an ^2 and Sobolev space by 




r 

X, dx absolutely continuous, '] 

S' = if2(A;K), 

^0= < 

X G jr 

x(0) = 0 = x{L ), . 

a^x G jr J 


and let (,) and || • || denote the standard ^2 inner product and norm on A specific unbounded operator A 
of interest in considering the wave equation EH is densely defined on ^ by 

Ax = {Ax){-) = —d^x{-) , dom (A) = C ^ ^ = ^ ■ 
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( 2 . 2 ) 







Operator A is closed, positive, self-adjoint, and boundedly invertible, and has a unique, positive, self-adjoint, 
boundedly invertible square root, denoted by A'^. The inverse of this square root is denoted hy J = {A'^)~^ € 
See Appendix El fLemma lA.fl) . [3] (Example 2.2.5, Lemma A.3.73, and Examples A.4.3 and A.4.26), 
and also [2] . These properties admit the definition of Hilbert spaces 

JTi = dom (A^), (x, 0i = X, A^ 0 , Vx,^ejri, (2.3) 

^i=jri©jr, ((x,p),(^,7r)}e =m(x, + i(p, , V xA e S'!, p,7r € S’ . (2.4) 

The corresponding norms are denoted by || • || i and || • || 0 . Similarly, it is also convenient to define the set 

^0 = ^0 © C . (2.5) 

Operators A and A^ are Riesz-spectral operators, see Appendix [Bl and [3]. Define orthonormal Riesz bases 


Pni) = Sm(Y ■) , ^ 

B = C Sr. , ^„(.) = ^ sin(Y-), 

for ^ and Si respectively (see Lemma IA.3I) . The input space for the optimal control problem of interest is 


W[r,t]=S 2 {[r,t];Si) (2.7) 

for all t G R>o, r G [0,t]. The corresponding norm is defined by 11^^(5)111 ds. 

2.2. Approximating optimal control problem. In order to formulate the action principle for the 
conservative infinite dimensional dynamics of m, define the abstract Cauchy problem [mil] by 

C(s) = u;(s), ^{0)=x€Si, (2.8) 


in which ^(s) denotes the infinite dimensional state at time s G [0, t] that has evolved from initial state x G 
in the presence of input w G #^[0, s]. The derivative in ()2.8p is of Frechet type, defined with respect to the norm 
II • II 1 . The mild solution (mi of (12.8|) is defined as 

^(s)=a;-|- f w{a) da (2-9) 

Jo 

for all X G Si, w G l^[0,s], s G [0,t]. In view of these dynamics, define the payoff (action) functional 
J)! ^ : [0, t) X Si X W[0, t)—7>]R for some t G K>o by 


x,w)= f f ||C(s)||i - f \\J^ w;(s)||ids -f V'(?W) 
Jo ^ ^ 


( 2 . 10 ) 


in which k, m G M>o are physical constants as per dm, /i G K.>o is a real-valued perturbation parameter, 
: Si^So X Si is a bounded linear operator given by 


J>^w 



( 2 . 11 ) 


I is the identity operator on Si, and ip : .^i—is any concave terminal payoff. In the integrand in (j2.10ll . 
note that ||^(s)||i = ||9^(s)|| is well-defined as ^(s) G Si for each s G [0,t]. Note also that ||77w;(s)||i = ||r(;(s)|| 
is well-defined as ran (J") = S;^. Consequently, (12.101) approximates the action functional (11.511 as 




( 2 . 12 ) 
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(2.13) 


where —J-R is the approximate kinetic energy functional defined analogously to (11.41) by 




du 


du 




Note in particular that the || • ||| term introduces a penalty on spatial ripples in §|(s, •) for fJ. ^ 0. This term 

vanishes for ^ = 0, so that T = by inspection of (11.41) and (12.131) . 

In order to ensure that the optimal control problem defined via the payoff functional ^ of (12.101) has a 
finite value, it is critical to establish the existence of a G M>o in (12.101) such that x,-) is either convex 

or concave for all t G [O,!'^) and x G To this end, it may be shown (see Theorem 12.11 at the end of this 
section) that the second difference A ^{t, x, w* 6 w) = X, w*) +J),) ,^(t, x, w*-Sw) 

of Jm^it,x,-) for an input w* G W[0,t] in direction w G W[0,t], 5 G K (with 5 0) satisfies 




— K (y) 


\w 




< 0 


(2.14) 


for all t G [0,t^), provided the terminal payoff ip is concave, where 

= (2.15) 

That is, the payoff functional ^{t,x,-) of (j2.10l) is strictly concave under these conditions. Consequently, 
the approximate action principle (modified to include a concave terminal payoff ip, and perturbed by /r G R>o) 
may be expressed via the value function : R>o x ^i^R, 


W^{t,x)= sup Jppjt,x,w). 

iuG)^[0,t] 


(2.16) 


By interpreting (12.161) as an optimal control problem, it is shown that the state feedback characterization of 
the optimal (velocity) input for the approximate action principle is defined via w*{s) = fc(s,^*(s)), where 
k{s,x) = VxW^{t— s,x). Here, ^*(-) denotes the trajectory (12.81) corresponding to input w*, and 

is a self-adjoint bounded linear operator that approximates the identity for small /i G R.>o (to be defined 
later). Consequently, by selecting a terminal payoff that forces the terminal displacement ^(t) to 2 (fixed apriori 
as per dO])), the corresponding initial velocity required to achieve this terminal displacement is shown to be 


wiO) = iAH^ A^ VxW>^(t, cm ^^A^X^ A^ VxW'^it, x). 

The characteristic equations corresponding to the Hamiltonian associated with (12.161) imply that this initial 
velocity determines the corresponding initial momentum costate. Here, it is convenient to define a scaled 

_ i _ i 

costate 7r(s) = ^ w^s), so that the initialization 7r(0) = p = mX^i ^ r(;(0) ultimately yields the terminal 

displacement z after evolution of the state and costate dynamics to time t G (0,t^). This evolution is governed 
by the abstract Cauchy problem 


C(s) 

7t(s) 




?(s) 

7r(s) 


-4® = 


■ 

A^ll. 


-kA^X^ A2 


dom (^®) = 


(2.17) 


in which ^(s) and 7r(s) denote the state and costate at time s G [0, t], evolved from ^(0) = x and 7r(0) = p. The 
uniformly continuous semigroup of bounded linear operators T®{s) G C{?Vi) generated by A® G ) yields 
solutions of (12.171) of the form 



for all s G [0,t], with ^ solving an approximation of the wave equation (II.1|) given by 




(2.18) 
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(2.19) 


























for s G M>o- Furthermore, is shown to converge strongly (as /i —?■ 0) to an unbounded, closed, and densely 
dehned operator A® on 1% = dom (.4®) = ^ x . This operator defines the related abstract Cauchy problem 


( i{s) 
V p(s) 


a;(s) 

p(s) 



dom (.4®) = ^ = ^ © , 


( 2 . 20 ) 


and is the generator of the Co-semigroup of bounded linear operators T®{t) G t G M>o, yielding all 

solutions of (12.201) of the form 


(pw)='^w(p)’ 

in which x{s) and p{s) denote the state and costate analogously to (12.181) . Crucially, the state x is the solution 
is the wave equation (ED itself. As the first Trotter-Kato theorem (e.g. 0) implies that the semigroup T® (t) 
converges strongly to T®{t) for t G M>o on bounded intervals, solutions (12.181) of (12.191) converge to solutions 
(12.211) of (11.11) as ^ 0. In this sense, solutions of the TPBVP (11.31) defined with respect to the wave equation 

(11.11) may be approximated via the optimal control problem defined by (12.161) . 

Where the terminal velocity is specified (rather than the terminal position as in ()1.31) b this same approach 
may be applied by employing the terminal payoff 


'tlj{x) = ipvix) =m{J J V, x)^ . 
In that case, the terminal momentum costate is given by 


TT{t) = A-^ V^W^{GA*{t))=A^T^A-^ V{t)) = ml} v . 


( 2 . 22 ) 


Hence, by solving the optimal control problem (12.16|) defined with respect to terminal payoff ipv of (|2.22|) . the 
infinite dimensional dynamics of (12.19|) can be propagated forward from a known initial position x G C 

to a known terminal velocity ^(t) = v £ As in the terminal position case, this approximation converges 
to the actual wave equation dynamics satisfying ^{t) = v € as /i —>■ 0. The rigorous development yielding 
this conclusion commences with a theorem concerning the concavity of the payoff functional ^ of (12.10p . 
Theorem 2.1. Given t G R>o, x G and concave terminal payoff the payoff functional 

^> ■) of h2.1 0\) is strictly concave. In particular, the second difference ^(t, x, w*5w) = x, w*+ 

Sw) — 2 ^(t,x,w*) + ^(t,x,w*—Sw) of the payoff functional ^{t,x,-) at any w* G W[0,t] is strictly 

negative as per 1^2.14\ ) for any direction Sw € W[0,t] in the input space defined by S € M., S ||wl||:;r[o,t] ^ 0- 

Proof Fix t G R>o, x G JTi, n;* G #'[0,t], Sw € W[0,f\ and <5 G M, with 5 ||w||:r[o.t] 0, as per the 

theorem statement. Define the trajectories corresponding to inputs w* and w = w* S w via (1^ as 

r) = f w{s) ds , (2.23) 

Jo 

where r G [0,f]. The integrated action functional in the payoff (12.101) is of the form F(^(s)) — T^{w{s)) ds, 
where V and are quadratic functionals given by 


Cir) = X + 


w 


'{s)ds, i{r)=x + / w* (s) + 6 w{s) ds = ^* (r) + S ^{r), f( 


V{m) = f lieWIII , T^{w{s)) = f \\J^ n;(s)||| , 

with operator as per (|2.1ip . Applying (12.23P in (j2.241) . 


V{C{r) + 6l{r)) 
T^{w*{r) + 5 w{r)) 


Vidx)) + S K {r), J w{s)ds'^ 6"^ {^) J w{s)ds 

T{w*{r)) + 6m {J w*{r), J w{r)) i + pfi {w*{r), w{r))i 

+ SHf)\\\JMrm+h^\\w{rm 


(2.24) 


(2.25) 


5 


(2.26) 










































Hence, combining (I2.10L (j2.25|) . and (j2.26|) 


X,W* +5 w)- X, W*) 


V 


= / V-(rW+<5|(r))-H(r(r))-[T'^K(r)+Jti}(r))-T'^(u;*(r))] dr + i;{C(t) + Sm - (t)) 


/ w{s)ds\ +d^(f) 

/ w{s)ds 

Jo / i 

Jo 


— 5m 


{Jw*{T),Jw{r))^+H^{w*{r),w{r))^ - 5^ {^) ||:7^i}(r)||l + Mr)||l 


dr 




(2.27) 


A corresponding expression for J!^ ^(t-^x^w* — 5w) — ^{tTX,w*) follows by replacing 5 with —<5 in (12.271) . 

Adding this expression to (12.2711 yields the second difference AJ^ ^{t,x,w*,Sw) of ^{t,x,w*) at w* in 


direction 5w, with 


= 5 '^ K 

Jo 


nr 

2 

/ w{s) ds 

— 5^ m 

Jo 

1 

2 


||J^w(r)||i||w(r)||i dr + Ailj{Cit),5 ^{t)), (2.28) 


where Atp{i*{t),6^{t)) = +6^{t)) — 2ip{^*{t)) — S^{t)) is the second difference of ip at ^*{t) 

in direction S^{t). With a view to dealing with first term on the right-hand side of (12.2811 . define qw = C(r) = 
w(a) da G and H : by Ho; = (uj, qw}i- Note that H is a closed linear operator (a functional) in 

£(^y,R). Also note that for w G W^.r^ r G [0,t], Holder’s inequality and Cauchy-Schwartz implies that 

.r i-r nr 

/ l|w(s)l|i < \/^l|w||^[o.r] , / \Ilwis)\ds= |(g^, w(s))i I ds < v^||g.ij|| 1 ||w||^[o,r] < 00 . (2.29) 

Jo Jo Jo 

That is, w G .ifi([0,r]; J^i) and Hw G .5fi([0,r];R). Hence, as and R are separable Hilbert spaces (separa¬ 
bility of the former follows by existence of a countable basis, see Lemma [A.31) . it follows by [3] Theorem A.5.23, 
p.628] (for example) that 


nr nr 

H / w{s) ds = / ni(}(s)ds. 
Jo Jo 


Recalling the definition of H, 
H 


J w{s) ds = (^J w{s)ds,qw'^ ~ J w{a)dcJj = 


'][s) ds 


(2.30) 


(2.31) 


while 


nr nr nr ! nr \ nr nr 

J ^ w{s) ds = J {w{s), qw) 1 ds = J (^w{s), J w{a)daj^ ds = J J {w{s), w{a)) i da ds 

- Jo Jo ll^('5)IU = (_^ l|w(s)||ids^ <r\\w\\‘^[o,r]<r\\yj\\l'io,t]’ (2-32) 

in which [3l Theorem A.5.23, p.628] is applied a second time to obtain the third equality, and the left-hand 
inequality in (12.291) is applied to obtained the upper bound. Hence, combining (12.311) and (12.321) in (12.301) yields 


w{s) ds 


< r llicl 


>r[0,i] : 
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(2.33) 


which in turn implies that the first term on the right-hand side of (12.281) is 


S^K 


2 ^ 
w{s)ds dr<S^K r dr ||w||^[o (, = k (^) . 

i -^0 

Substituting (j2.33p in (j2.28l) thus yields the second difference bound 


(2.34) 


As the second difference Aip{^*{t),6 ^{t)) is non-positive by concavity of ip, (12.341) is strictly negative if m/i^ — 
K (^) > 0. That is, if t S [0, i^^), where G IR>o is as per (j2.15|) . Under these conditions, it follows immediately 
that the payoff functional ') of (|2.10|) is strictly concave. □ 

3. Fundamental solution to the approximating optimal control problem. A fundamental solution 
in this optimal control context is an object from which the value function of (12.161) can be computed given 
any concave terminal payoff ip. This fundamental solution is constructed via four auxiliary control problems. 

3.1. Auxiliary control problems. The auxiliary control problems of interest employ the same running 
payoff as used in (12.101) to define the approximating optimal control problem (12.161) . A specific terminal payoff 
is used in each auxiliary problem. Two of these terminal payoffs depend on an additional function z G 
describing the terminal displacement. These terminal payoffs are denoted by '0^’° : x tK, ip>^’°° : 

X .^1—^-KU {—oo}, and ip° : )>K, where /r, c G M>o denote real-valued parameters. Specifically, 


ip°{x) = 0, ipf^’‘'{x,z) =-^\\ICfj,{x - z) 


V’°°{x,z) = 


0, ||/C^(x-z)4 =0, 

- 00 , ||/C^ (a; - z)||i > 0, 


(3.1) 


where /C^ G is a boundedly invertible operator to be defined later. Using these terminal payoffs and 

a fixed real-valued parameter m G (0,m), the four auxiliary control problems of interest are defined via their 
respective (auxiliary) value functions 

TU'" : R>o X JTi : ]R>o x .Ti x .Ti : ]R>o x JTi x JTi U {-oo}, 

where 


W^{t,x) 


lU^’"(t,a;,z) 




sup Jl^^oit,x,w), 

sup •^^.v,/',c(.,;,)(i,a;,u;), 

sup '^™.v,<^,c=o(..^)(i>a;,w;). 
we^[o,t] 


W^'‘'{t,x,z) = sup At,x,w), 


(3.2) 

(3.3) 

(3.4) 


The majority of the subsequent analysis will concern the value function W^’'^ of (13.31) and its convergence to 
pj^^,oo ( 13 , 41 ) as c —>■ 00 . Ultimately, W^’°° plays the role of the fundamental solution for the optimal control 
problem (I2.16L in the sense that 


W>^{t,x)= sup {W>^'°°{t,x,z) +ip{z)} (3.5) 

for all t G M>o, x G . The remaining value functions lU^ and lU^’ are useful in ensuring that these auxiliary 
problems are well-defined. In particular, note by inspection of the value functions (ESD-dll that 

W^it, x) > X, z) > X, z) > X, z) > -00 (3.6) 


for all t G K>o, x,z £ . Here, the last inequality follows by noting that the specific constant input w G W[0, t] 

defined by w{s) = j{z — x) for all s G [0,t] is suboptimal in the definition (13.41) of W^’°°{t, x, z). In particular, 
W^^’°°{t,x, z) > ^,*, 00 (. ||z — a;||| > — 00 . The following is assumed throughout. 

Assumption 1. W^{t,x) < 00 for all ^ g (0,1], t G (0,t^), x G 
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3.2. Fundamental solution. In order to construct a fundamental solution to the optimal control problem 
(12.161) . it is useful to define the value functional : M>o x by 


Wf^{t,x)= sup + 




(3.7) 


Theorem 3.1. The value functionals and of 12. 1 6\) and fj*. 7| ) are equivalent, with W^{t,x) = 
x) for all t G [0, and x G 2^^. 

Proof Fix t G x G . Substituting (13.41) in (13.7|) . and recalling p.ll) . 


Wf^{t,x)= sup sup iJ^.o{t,X,w)+ljj^^°^{^{t),z) + 'llj{z) 
zeSTi wei^[o,t] I 

= sup sup I J^,o(t,x,w)+ipf^’°°(^(t),z)+ if(z) 

tuG^[o,t] zeaTi L 


(12.81) holds with 
C(0) = a; 


781) holds with 
C(0) = a; 


= sup { J^^^o(i,x,w)+ sup {^>^’°°(f(t),z)+ip(z)} 


wG'^lOU] 


zG^l 


TH]) holds with 
f(0) = a; 


(3.8) 


By inspection of dSlD, the inner supremum must be achieved at z = z* = ^(t), with sup^g^j^ {V-^--(C(t),z)- 
'4’i.^)} = ^*) + ^{z*) = 0 + tl^if.it)) = ip{f{t)). Substituting in (13. 8|) and recalling (12.161) yields that 


Wf"{t,x)= sup <J'^.,poit,x,w)+ip{^{t)) 

tuG^[0,t] ' 


(12.81) holds with 
C(0) = X 


= sup J'^Jt,x,w) = W>^{t,x). 


□ 

Theorem 13.11 provides an explicit decomposition of the approximating optimal control problem associated 
with the principle of stationary action. In particular, it provides a means of evaluating of the value functional 

of (I2.16P for any concave terminal payoff f}, including that of p.22|) . In this regard, inspection of (j3.7l) via 
Theorem o reveals that W^’°° of (13.41) can be regarded as an approximation (for ^ 0) of the fundamental 

solution to the TPBVP (11.31) via the principle of stationary action. Consequently, characterization of an explicit 
representation of W^’°° is important for its application in the computation of W^. 

3.3. Explicit representation of the fundamental solution. In order to characterize the fundamental 
solution of the approximating optimal control problem (12.161) via Theorem 13.11 an explicit form for the value 
function W^’°° of (13.41) may be constructed via three steps: 

O Show that the value function of (13.4p may be obtained as the limit of W^’'^ of (13.3p as c —>■ oo; 

© Develop a verification theorem that provides a means for proposing and validated an explicit represen¬ 
tation for the value function of (13.3|) : 

© Find an explicit representation satisfying the conditions of the verification theorem of ©, and apply the 
limit argument of O to obtain the corresponding representation for of (13.41) . 

3.3.1. Limit argument — O. This first step is formalized via the following theorem. 

Theorem 3.2. The auxiliary value functions of satisfy the limit relationship 

lim W>^'%t, X, z) = W>^’°°(t, X, z) (3.9) 

C—¥00 


for all t G [0, t^), x,z € . 

In order to demonstrate the limit property summarized by Theorem 13.21 it is useful to first note that a ball 
of any fixed radius centered on z G can be reached by a sufficiently near-optimal trajectory defined with 
respect to (13.31) . 


















Lemma 3.3. Fix t € [0,t^) and x,z £ For each e £ R>o, there exists a c = c| ^ ^ ]^> 0 : 5 £ (0,1], 

such that — -z|| 1 < e for all c £ (c, oo) and d £ (0, d), where denotes the trajectory of system 

2 _ 

corresponding to any 5-optimal input w‘^’^ £ W[0,tj in the definition \3. S\) of W^’'^(t,x, z). 

Proof. Fix t £ [0,i^) and x,z £ . Recalling the assumed bounded invertibility of on see (13.11) . 

set Kf^ = £ R>o- Suppose the statement of the lemma is false. That is, there exists an e G K>o such 

that for all c £ R>o and 6 £ (0,1], there exists a c S (c,oo) and 6 G (0,5) such that |k°’'^(t) — z||i > e. So, 
given this e £ M>o, choose a specific c £ ]R>o and 6 £ (0,1] such that 

( 2 ^) W^{t, x) - X, z). (3.10) 

(Note that this is always possible by Assumption[T|) Let c £ (c, 00 ) and 5 £ (0,5) be such that |k^’'^(t) — -^ll 1 > e 

2 

as per the hypothesis above. Note by bounded invertibility of /C^ on , 

<\\K-^K^{C^\t)-z)f, <K^ \\lCAi^’\t) - z)\\l . (3.11) 

" ^ "2 " "2 

Hence, by definition of any 5-optimal input in W^’‘^{t,x, z) of (13.31) . 

Wf^^%t,x,z) - 5 < {t,x,w‘=’^) = J^^^o{t,x,w‘=’^) + tlji^’‘^ (r’'^(f), z) 

< W^{t, x) - f ||/C^ (^’^(0 - ^)fi < w^{t, x) - (^) , 

II I I 2 fX 

where the equality follows by dMl, while the inequalities follow by suboptimality of w‘^’^ in the definition (13. 3|) 
of tf/Ai.c, (13.611 . and (13.111) . Consequently, w'^{t,x) — W^'°°{t,x,z) > W^{t,x) — W^’^{t,x,z) > (j^)e^ — 5 > 

( 2 ^) ~ 5, which contradicts (13.101) . Hence, the assertion in the lemma statement is true. □ 

An upper norm bound on near-optimal inputs is also useful. 

Lemma 3.4. With c £ K>o, 5 £ (0,1], t £ [0,t^), and x,z £ fixed, any input w‘^’^ £ W[0,t] that is 
S-optimal in the definition ifOl) of W^’'^(t,x, z) satisfies the bound 

\\J^W^’^\\y^[ 0 ,t]< M^^^^^^{t,x,z) <W{t,x,z) (3.12) 


where 

M>^'‘^’^{t,x,z) 


'w'"'"{t, 


,z) - Wf^'%t,x,z) +6 


\{m — m) 


M^(t, X, z) 


W^{t,x) - Wf^’^{t,x,z) -b 1 
h{m — to) 


_1 

2 


Proof Input w‘^’^ G W[ 0 ,t] is respectively sub-optimal and 5-optimal in the definitions (13.2p and (13.3p of 
W^''^{t,x,z) and W^’‘^{t,x, z), so that 


IF ’ (t,a;,2:) > §11^’ (s)l|i 

W^^^it,x,z) - 5 < JC.,^c(.,,)(t,x,u;^'^) = £ f ||r’'(s)||| 


= \\J^w^’\s)\\Us + r’^ {e’\t),z) , 
f\\j^w^’\s)\\Us+r’^ {e’\t),z) , 


in which ^‘^’'^(•) denotes the trajectory corresponding to The left-hand inequality of (13.121) follows by 

subtracting the second inequality above from the first, while the right-hand inequality of (13.121) follows by 
application of (13.61) in the definition of M^'‘^'^{t, x, z) to yield the upper bound M^{t, x,z). □ 

Lemmas 13.31 and 13.41 facilitate the proof of the required limit property of Theorem 13.21 
Proof [Theorem 13.2] Fix t G [0, t'^) and x,z £ JT . Observe that for all c G R>o, ci G R>c, 


1F'^’=(<, X, z) > tF^’'=i {t, X, z) > {t, X, z ), 


z) > {x, z) > (x, z ), 
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where the first set of inequalities follows immediately by inspection of (EH), which in turn implies the second 
set of inequalities by inspection of (13.31) and (13.4p . That is, W^’'^ is non-increasing in c and satisfies 




(3.13) 


In order to prove the opposite inequality required to demonstrate EH), a sub-optimal input for is 

constructed from a near-optimal input for To this end, fix an arbitrary e S M>o- With and 

as per the statement of Lemma [3.31 there exists a c S R>o and 6 G (0,1] such that 

<e (3.14) 

for all c G (c, oo) and 6 G (0,5). Define a new input G W[0,t] by 

= w^’^(s) + j (z — C^’‘^(t)) (3.15) 

for all s G [0,t]. By inspection of (12.8|) and (I3.15L the corresponding state trajectory ^“’‘^(•) satisfies 

r’^(s) =x + [ da = x+ f da + I (z - f’^(t)) = f’^(s) + f (^ - ^’^(i)) , (3-16) 

Jo Jo 

so that ^'^’‘^(0) = X and = z. However, as need not equal z, (13.11) implies that (C^’^(i), z) = 

— f ||/Cm — 2)11^1 < 0 = '0^’°°(|‘=’'*(t), z). So, for all c G (c, oo), S G (0,5), 

Z II II 2 

x,z)-6<Ji^ it, X, = j\ ||r’'(s)||i - ^ \\J^ «;'=’'(s)||i ds + z) 

V w 2 2 

< / f \\t\s)\\l -fWJ^ ^b"’'(s)||i ds + r’^it^it), z) + A^^’^it, X, z) = {t, X, + Ai^’^it, x, z) 

Jo 2 2 \ ! 


< W^^’^(t,x,z) + A^’^{t,x,z), 

where sub-optimality of in the definition (j3.4D of W^'°°it,x,z) has been applied, and 


(3.17) 


A>^^^it,x,z) = f (iir’'(s)ii| - iir’'(s)ii|) - f {\\j>^w‘^’\s)\\i - wj'^w^^^s)^) ds 

< f f (iir’'(s)iii + \\e'\s)\\.) iir-^(s)- c^is)\\. + f (n+ wj^w^^’^is)^) x 


||JM(^c.^(^)_^c,^(^))|, 


(3.18) 


(Here, the upper bound follows by the triangle inequality.) Note that A^’‘^{t,x, z) is parameterized by e G R>o 
via c and 6 (see Lemma [3.31) . In order to bound the right-hand side of (13.181) . Holder’s inequality implies that 
for any Hilbert space (with norm denoted by || • \\^) and any z, z G t] = ^2i[0, ^]; ^), 


(llz(s)ll^ + llz(s)ll^) ||z(s) - z(s)||^ ds < ^ (llz(s)ll^ + \\zis)\\^r dsj ^ ||z(s) - z(s)|r^ ds 

1 . 

< V2 (^p||^[o,t] + PII^[o,t]) P “ ^IP[o.t] - (Pllar[o,t] + PI|jr[o,i]) P - ^lljrio.t] > ( 3 . 19 ) 

in which p|l^[o t] ^ fo P(®)ll^'^®' Meanwhile, the triangle inequality states that 

Pllarfo.t] < P ~ ^IP[o.q + Pllaf[o.t] ■ (3.20) 

With a view to applying p.lOp and (13.201) to the right-hand side of (13.181) . note that by (12.111) and (13.151) . 
(w^’^(s) - n;^’ps))||l = ||f7(zi^’ps) - «;^’ps))||| + |P'’’ps) - n;=’ps)||i 
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= \\j Hz - r’'w)ii|+iii(^ - r-'w)ii| = ^ wjaHz - + # ii^ - eHm\ 

< Ik - r’^wiil < k, 

where commutation oi J & L{^) and follows by Lemma FA.II Hence, integration yields 




€ . 


Consequently, Lemma (|3.2Qp . and (|3.2ip together imply that 


<M^(<,a;,z), \\j>^ 

Similarly, (13.141) and (13.161) imply that 


w 


l^[o,t] — 


^C,0 _ 




(3.21) 


< M^{t, X, z) + " £, (3.22) 


1 . 

T’" WII1 d^y < P (k) " = (I) 5 e . (3.23) 


As is sub-optimal in the definition (13.41) of z), while (t), z) = 0 by (13.ip and (I3.16L 

W>^’°-it,x,z) > f f ||r'(s)||i - f \\J>^w'^Hs)\\lds + r’^{t\t),z) = f - f ’ 

Jo ^ ^ 

or, equivalently, |||''’'^||^[o.t] < f W^'°°{t,x,z) + ^ \\J^ Applying the second inequality of (13.221) , 

the triangle inequality, and (13.231) yields the respective inequalities 


fc,(5 




< M^’^{t,x,z) 


tc,(5 I 




< M>^’^{t,x,z) + {A)- 


(3.24) 


in which a;, z) = [f lH^’“(t,a;) + f e+^ M^{t,x,z)H. So, combining (nT^ . (IX^ . dS^D, 

(I3.24P in (|3.18l) yields that 


+ w<^Hy[0,t] + \\J^ 


< -£= 
- V2 


(2 X, z) + (I) L) (I) L + ^ y M^(t, X, z) + = g = 0 (e) ( 3 . 25 ) 


This bound is independent of c and 5. Fix any e G M>o. With t, x, and z given, there exists an e G M>o such 
that X, z) < e. Inequality (I3.17p then implies that x,z) — 5 < x, z) + e for all c G (c, 00 ) 

and S G (0,d). So, sending d —>• 0+ and c —>■ 00 yields limc_>.oo VF^’'^(t, x, z) < IF^’°“(f, x, z) -|- e. As e G M>o 
is arbitrary, it follows that limc_>oo VF^’'^(t, x, z) < W^’°°{t, x, z) for any t G [0,t'^), x, z G Combining this 
inequality with (13.131) completes the proof. □ 

3.3.2. Verification theorem — ©. The second step in explicitly characterizing the fundamental solution 
to the optimal control problem (12.161) utilizes a verification theorem. In stating this theorem, it is convenient 
to define operator G £{^) by 

X^y = {X + H A)~^ y, dom (I^) = JT, ran (I^) = JTq , (3.26) 


where boundedness, the stated range, and a number of other useful properties follow by Lemma lA.41 
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Theorem 3.5 (Verification). Given fi G R>o, S M>o as per i2.15]} . c G K >07 and z G suppose that 
a functional W G C([0,t^] x x nC'^((0,t^) x x .^i;K) satisfies 

dW 

0 = --^{t,x,z) + H{x, y,W{t, X, z)), (3.27) 

W (0, X, z) = fi>^’'^{x, z) (3.28) 

for all t G [0, t^) and x G , where If, x, z) G denotes the Frechet derivative of W{t,-,z) at x € , 

defined with respect to inner product (,) i on , and F[ : SF\_ x is the Hamiltonian 

H{x,p) = f ||x||| + ^ ||l| p\\l, (3.29) 

in which If is the unique square root ofl^ of iS.26\] . see Lemma \A.f\ Then, W{t,x,z) > 2 )(^ja:,w) for 

all X G ^ 1 , w G W[0,f\, t G [0,t^). Furthermore, if there exists a mild solution f* as per 112. fA) corresponding 
to a distributed input w* defined via the feedback characterization 

w*{s) = k{s, f,*{s)), k{s,x) = s,x,z), (3.30) 

such that f*(s) G for all s G [0, t], then W(t, x, z) = 2 ,)(t, x,w*), and W{t, x, z) = W^’^^ft, x, z). 

The verification Theorem 13.51 may be proved via completion of squares and a chain rule for Frechet differ¬ 
entiation, summarized via the following preliminary lemmas. 

Lemma 3.6. Given any p G the quadratic functional >—>■ K., Trf(uj) = (p, w) i — ^ w;|||, 

satisfies sup„,g^^ '^p{w) = Tr^(w*) = \\If A^ p||l with w* = A jli A^ p G and as per h3.26\) . 

Proof Fix p G and w G t^i. Note that A^ p & Sf and J w ^ = dom (^), by Lemma lA.il Note 

also that (>7^ + pfl)w = J {I + pf A) J w = J Iff^ J w. Hence, by definition of and (I2.11L 


<H = -f {w, JIp^ Jw)i- 


(3.31) 


As I^ ^ has a unique, positive, self-adjoint and boundedly invertible square root (Lemma lA.41) . it follows that 
(p, w)i = {If A^ p,If_i^J w)i and {w, J Ifi^ J w) i = Wlp ^ J ry||i, where If : and If G £( J7). 

Substituting in (13.311) . 

= -T ^ n A^p, ip Jw).^ = ^ \\If AipWl - f l|i;" Jw - Axf AhWl 

= ^ \\il A^ p||| - f 

for all w G where w* G is as per the lemma statement. Taking the supremum of Trfiw) over w G 


sup 7r^(u;) = 2 ^ \\If pf - IR inf \\I^ ^ J {w - ri;*)|| i = ^ \\If A"^ p||| = <(w*) 






as per the lemma statement, with the supremum attained at w* G . 0 

The following lemma is standard and its proof is omitted (see for example my 

Lemma 3.7 (Fundamental Theorem of Calculus). Given any p G M>o, t G (0,t^) with t^ G M>o as per 
Il2.15\) . X G w G W[0,t], let ^ : [0,t]— denote the mild solution i2.9\} . and let W G C{[0,i^] x x 
fffi ;M) n ((0, b“) X X ; M). Then, for any t G [0, t], 

W{t-T, f{T),z) -W{t,x,z) = J ^(s), z) + {VxW{t - s,f{s),z), w{s))ids, 
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where VxW{t,x, z) € denotes the Riesz representation of the Frechet derivative of W{t, ■, z) at x, defined 
with respect to inner product (,) i on . 

Lemmas 13.61 and 13.71 facilitate the proof of the verification Theorem 13.51 

Proof [Theorem l3.5| Given t^ G ]R>o and z G ,letW G C'([0, t^] x x ; K)n(7^ ((0, t^) x x ; R) 
denote a solution of (13.271) - (13.281) as per the theorem statement. FixW G W[0,f\, t G and let ^(•) denote 

the mild solution (|2.9I) of (|2.8I) with ^(0) = x G JT and w{s) = w{s), s G [0,t]. Recall that f{s) G JT for 
all s G [0,t]. Set p{s) = VxW{t — s,f{s),z), and note that p{s) G for all s G [0,t]. Hence, both terms in 
H{f{s),p{s)) as per (13.291) are well-defined for all s G [0,f]. In particular, Lemma 15^ implies that 


1 

2 m 


IfA^VxW{t-s,as),z) ^ > {VxWit- s, as),z),Wis))i - ^\\J>^w{s)\\l 


(3.32) 


for all s G [0,f]. Hence, substituting (13.321) in (13.271) yields that 0 > —^^{t — s, f(s), z) -I- (Va;lT(t — 

s, f{s),z), w{s)) 1 + ^ |k(s)||i — ^ ?JJ(s)||i for all s G [0,t]- Integrating with respect to s G [0,t], the 

2 2 2 

Fundamental Theorem of Calculus fLemma 13.7p implies that 


r* dW - - F 

0> / — —{t-s,f{s),z) + {VxW{t-s,^{s),z),w{s))ids + 


/o 


dt 


= f{t), z) - W{t,x,z) 


'0 


f ||e(s)|ii-f ds. 


(s)fi -f l|J^W(s)||i ds 


Applying (13.281) and (12.101) to this yields W{t,x,z) > as per the first assertion. In order to 

prove the second assertion, define w* as per (j3.30|) . By assumption, f*{s) G and VxW{t,f*{s),z) G tii’i for 
all s G [0,t]. Hence, the argument from (13.321) onwards may be repeated, this time with equality, yielding that 
W{t,x,z) = = W^^’^{t,x,z) as required. □ 

3.3.3. An explicit representation of the fundamental solution of ()3.4p ©. The third step 

in explicitly characterizing the fundamental solution to approximating optimal control problem (I2.16|) involves 
the construction of a functional that satisfies the conditions of Theorem 13.51 followed by an application of the 
limit argument O. To this end, define the bi-quadratic functional : [0,F) x x .^i—by 


W>^'%t, X, z) = i(x, r^’^(t) x}i+ (x, Q^’^(t) z)i + i (z, n^^'‘^(t) z) 1 


(3.33) 


where TZ^’’^ : [0, )—;►£() denote operator-valued functions of time that satisfy the operator 

differential equations 


V^’^it) = kI+^ V^'^{t) A^ V^’^t), 

p^’"(0) = -cM^, 

(3.34) 


QM.c(o) ^ +c7W^, 

(3.35) 

n^'^t) = A (Q/^.=)(t)' Ai X^ A^ Q'^’^(t), 

7^^.-(0) = -cMf,, 

(3.36) 

in which X denotes the identity operator on , and 



M^ = (/C^y/C^G£(^i) 


(3.37) 

is self-adjoint, positive, and boundedly invertible by definition of /C^. It may be shown that the functional IF^’'^ 
of (13.331) satisfies the conditions of the verification Theorem 13.51 therebv orovidine an exolicit renresentation 
for the value function IF^’'^ of (13.31) in terms of the operator-valued functions 7?.'^’'^. 

Theorem 3.8. The functionals IF'^’'^ of 15.51) and IF'^’'^ of 15.551) are eauivalent. That is. 

W^’‘^{hx,z) = W^^'%t,x,z) 


(3.38) 
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for all t G [0, t^), x,z G . 

Proof. As indicated above, it is sufficient to demonstrate that W^’‘^ of (13.331) satisfies the conditions of 
Theorem 3.6. To this end, fix t G [0, cc, z G ,^i. Firstly, in order to show that W^’‘^ satisfies (I3.27L note 

that cc, z) and are Frechet differentiable. In particular. 


{t, a:, z) = i {x, x)^ + {x, z) i + i (z, z) i , 


—^[t,x,z)-^ 

X, z) = X + z . 


(3.39) 

(3.40) 


With a view to verifying that (13.2711 holds, further note that 

f ||x||| = i (a:, Kla;)i , (3.41) 


+ ^{z,i{Q'^’‘^{t)yA^I,A^ Q^’%t)z). 


(3.42) 


where the second equality also exploits the fact that is self-adjoint. Hence, substitution of (13.391) (I3.40F 

(I3.41F (13.421) in the right-hand side of (13.2711 yields the bi-quadratic functional (in x and z) 

i (x, X{t)x)i + (x, 3^(t)z)i -b i (z, Z{t)z)i (3.43) 

in which X{t) = -iP'^’^(t) + kI+Z Ai If, Ai r>^’%t), y{t) = Xf, A^ 

and Z(t) = + A (Q/^’^(t)y A^ If, A^ However, (I3.34L (13.351) . p.36l) imply that these three 

operator-valued functions are identically zero, so that (13.431) must be zero. Hence, the explicit functional W'^ 
of (13.331) satisfies (13.271) . 

Secondly, (13.401) . in which : ,^i—>-,^ 1 , implies that Va:tF^’'^(t, x, z) G ,^i. 

Finally, in order to show that satisfies the initial condition (I3.28L note by inspection of (13.331) . the 
initial conditions of (I3.34L (13.351) . (13.3611 . and the identities J A^ = I and Aif, = iJCf,)' Kf,, that 

IF'^’=(0, X, z) = i (x, 1P^’=(0) x) 1 -b (x, Q'^’=(0) z) 1 -b i (z, 7^'^’=(0) z) i 

= \ (x, {-cMf,) x) 1 -b (x, (-bcTW^) z) 1 -b 5 (z, (-cMf,) z}i =-§ ||/C^ (x - z)||| = if^’‘'(x, z), 


as required by ()3.28p . That is, the explicit functional W^’‘^ of (I3.33p satisfies the conditions (I3.27L (13.2811 of 
Theorem 13.51 Consequently, IF^’'^(t, x, z) = VF^’'^(t, x, z). □ 

Theorem 13.81 provides a representation for of (13.3p . via of (I3.33L in terms of operator-valued 
functions 77'^’^ satisfying (I3.34p . p.35l) . (13.361) . Candidate definitions for these functions are Riesz- 

spectral operator-valued functions of the form (IC.ip . see Appendix [C] In particular, define an operator-valued 
function of the form (jC.lIl by 


^ pO’fyt) (x, (pn)^Pn, (3.44) 

n—1 


where {pO’'^(t)}„gN denotes the set of eigenvalues of P^’’^{t) corresponding to its eigenvectors {(^n}nGN defined 
by the Riesz basis (12.61) for ,^i. Motivated by the initial condition 'P^’°(0) = —cAif, specified in (I3.34F restrict 
Aif, to be a Riesz-spectral operator of the form (IB.ip . with simple (i.e. non-repeated) eigenvalues 
Note in particular that p((’'^(0) = —cmfy Analogously define operator-valued functions and Select 

the respective eigenvalues of the operators in the range of these three operator-valued functions to be 


Pii-m = 


tan (ujH t -b C’'^) ’ 


€’%t) = +- 


i + (i 


;)2y sin (w)) t-b C’^) ’ 


(3.45) 
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(3.46) 




for all ^ G (0,1], t G c G R>o, where 



1 1 1 

\ A rrin c’ / 

aKmCc tan(a;((t-f 6»'(’°)_ 


< = [i^)K]^, K = 




1 + An 

< = [(^)A()]^ A„ = (Yf, =tan-i(^j^). 


(3.47) 


Note by inspection that {An}, {A((}, (a^)}, {w((} define strictly increasing sequences in n G N. In particular, 

A} < Ai' < A(( < A((, = ^ , (3.48) 

with corresponding inequalities holding for a((, 

In order to establish that the Riesz-spectral operator-valued functions defined by (13.441) - 

(13.461) satisfy the respective operator-valued initial value problems p.34l) - (l3.36l) . it is important to first establish 
differentiability of these operator-valued functions, given a specific choice of initial condition operator 
This can be achieved by application of Lemma 1C.II In particular, motivated by condition (i) of Lemma 
1C.II (concerning strict monotonicity of sequences {p((’'^(t)}, {^n’‘^(^)}, ^ G N), it is convenient by 

inspection of (I3.45p - (I3.47I) to select to be a Riesz-spectral operator of the form (|B.1|) with eigenvalues 

satisfying That is, 


oo 

a; = y] mO {x, (pn)]. Pn , 

n—1 



^ I + A„^ ^ 


X G dom {Mfj) = . (3.49) 


(Note that G C{^i) as {/i((}rtGN is bounded.) The eigenvalues (I3.45l) - p.46|) subsequently simplify to 


— “it? 


tan f-I-tan i 




sin t-I- tan ^ 




1 


For convenience, define 


,l+(^)2y 

c = \/m K tan . 


tan t-I-tan i 


(3.50) 

(3.51) 

(3.52) 


Lemma 3.9. Given p G (0,1], c G (c,oo), c G K.>o as per hS. 5ill) . and G £(J?7i) as per 

the Riesz-spectral operator-valued functions of the form and defined by the respective 

eigenvalues \3.50\) - \3.51\] satisfy Q^’‘^{t), G C{^i) for every t G [0,t^), while 'p'^’'=, : 

[0, )—>■£(.^i) are Frechet differentiable and satisfy the initial value problems )i3.34\ )- f3.3fi\} . 

Proof. The proof proceeds by demonstrating that the conditions of Lemma 1C.II hold for each of the 
Riesz-spectral operator-valued functions thereby demonstrating their Frechet differentiability. 

Satisfaction of the initial value problems (I3.34I) - (I3.36|) then follows by inspection. 

In order verify that condition (i) of Lemma IC.Il holds for each of the Riesz-spectral operator-valued functions 
Qu,c^ strict monotonicity of their respective eigenvalues must be demonstrated. To this end, by 

inspection of the eigenvalues (13.491) of it is straightforward to show via (13.471) that 

c.((tG [0,^), cc^t + 0^.-G (tan-i(^), y2 + tan-i(^)) C (0, f) 
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(3.53) 









































































for all fi G (0,1], t G [0,f^), c G (c, oo), where c G M>o is as per (13.521) . Hence, by inspection of (I3.50p - (I3.51|) . 
the eigenvalues of operators are well-defined for all /r G (0,1], t G [O,^'^), c G (c, oo), 

and n G N. Furthermore, strict monotonicity of the sequences {a]]} and jw]]} in n G N, and strict monotonicity 
of the trigonometric functions tan and sin on [0, §), implies that the sequences {p((’'^(t)}, 
are strictly monotone in n G N for all /r G (0,1], t G [0,f^), c G (c, oo). It is straightforward to see that the 
respective closures of these sets of eigenvalues are totally disconnected. Hence, condition (i) ot Lemma IC.ll 
holds for each of the Riesz-spectral operator-valued functions 

In order verify that condition (ii) of Lemma IC.ll holds for each of the Riesz-spectral operator-valued functions 
first recall that by (13.531) that the functions of (|3.50I) - (I3.51I) are continuous on 

[0,t^), for every p G (0,1], c G (c, oo), and n G N. These functions are (twice) differentiable, with 




<’“(i) = ^A;)9r(f)C’^(t), 


K’°(0) =-cmO, (3.54) 
q((’^(0) =-hcm(], (3.55) 

r^’^{0) = -cm^, (3.56) 


for all fi G (0,1], t G [0,t'^), c G (c, oo), and n G N. Hence, the first and second derivatives (I3.54I) - (I3.56I) must 
also be continuous by inspection. That is, condition (ii) of Lemma fC.ll holds for each of the Riesz-spectral 
operator-valued functions 

In order verify that condition (Hi) of Lemma IC.ll holds for each of the Riesz-spectral operator-valued 
functions note by inspection of (|3.48l) and (I3.50I) - (I3.56I) that 


K-^(f) I < ^ ^ < oo , |p(]'^(t) I < ^ A]], (m;-=) 2 = < oo , 

/ iTl rt 

Ipr (01 < ^ A(i, < 00 , 


for all p G (0,1], t G [O,^^^), c G (c, oo), and uniformly in n G N, with analogous bounds holding for qK’‘^{t) 
and and their first and second derivatives. That is, condition (Hi) of Lemma FC . 1 1 holds for each of the 

Riesz-spectral operator-valued functions ■p^’'=, 7^^’'=. 

In summary. Lemma TC . 1 1 thus implies that the Riesz-spectral operator-valued functions 72.^’'^ : 

[0, )—>■£(.^i) of the form (13.441) and defined by the eigenvalues (I3.50I) " (I3.51I) are Frechet differentiable. Fur¬ 

thermore, their Frechet derivatives are also Riesz-spectral operators, and take the form (1C.21) . Hence, combining 
(1C.21) and (13.541) . and recalling Lemma IB^ 


P^’'=(f) X = Y^ {X, = i 


n—1 


n—1 


Ar) 


1 + /i^ Ay; 




oo 

V^(l A„)"^ V^P((’''(0) {X, <Pn)i ‘fn 


n—1 


= (kI -f i P''’^(7) r^'' 


(3.57) 


for all p G (0,1], t G (0, t^^), c G (c, oo), x G . Recalling the definition (13.491) of the eigenvalues of 


P^’^(0)x = ^pr(0) {x, 

n—1 


oo 

-cm^ {x, Pn) 1 (fn = -cMfj. X , 

n—1 


(3.58) 


for all p G (0, 1], c G (c, oo), x G . That is, p.57l) and p.58l) imply that satisfies the initial value problem 

(I3.34F Analogous calculations similarly imply that and 72'^’'^ satisfy (I3.35|) and (13.361) respectively. □ 
Given the role of the eigenvalues (13.491) of the operator Aifj, in the definition of operators ■p^’'=, 72^’“^, 

it is convenient to construct a closed-form for AI^, and subsequently /C^ of (|3.37p . 

Lemma 3.10. /C^ of iS.37\ ), are bounded, self-adjoint, positive, and boundedly invertible, with 

M. II X = {A~^ -\- p? x , X £ dom{Mi_i) = , (3.59) 
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K^x = Mfi X, 


X G dom (JCfj,) = ^1 . 


(3.60) 


Proof. Recall that A of (12.21) is a Riesz-spectral operator of the form (IB.II) . with eigenvalues {A„}„gN (see 
Lemmas IA.2I and IB.61) . Consequently, noting the form (IB.21) of the identity I, it follows that = I + lA A is 
also a Riesz-spectral operator of the same form (EB), defined on via (13.261) . with eigenvalues {H-^^ A„}„gN. 
Furthermore, as is self-adjoint and positive (by Lemma |A.1I) . it also has a unique self-adjoint and positive 

square root ^ : ,£b—, which is also a Riesz-spectral operator of the form (IB.II) by Corollarv lB.51 Similarly, 
A^ and hence ff = {A^)~^ are Riesz-spectral operators of the same form (see Lemma FB.61) . In particular. 


1 ^ 

X = '^{1 + A„)2 (x, (^„) 1 (pn , 

n—1 


J X 


E 


1 

EE 


(x, Pn) 1 Pn 1 


X G dom (I^ ^) = ^ , ran (I^ ^, 
X G dom [J) = , ran {J) = ^ . 


(3.61) 

(3.62) 


Applying Lemma FB. 2 1 the composition =1^,"^ J : is also a Riesz-spectral operator, with 


OO 

X = Ifi^ J X = '^ 

n—1 


^ 1 + A„ ^ ^ 


OO 

{X, pn)^ Pn = J 2 ^^ 
n—1 


Mfj, X, X e dom {Mfj) = JA , 

(3.63) 


where the third and fourth equalities follow by definition (I3.49P of the eigenvalues {mOlngN of Furthermore, 
again applying Lemma IB^ and the fact that J and A are Riesz-spectral operators. 


Ml,x = M^M^x = ^ 


1 A, 

An 


{x, Pn)^ Pn = X] V^) 


= J {X + p'^ A) J X = {A-^ + P^X) : 


X G dom {Aii) = . 


(3.64) 


(Note that this equivalently follows from (13.631) via commutation of X^ ^ and J in = X^ ^ JX^ J.) 

Applying Lemma FA.II A~^ + p^X is bounded, self-adjoint, and positive, and so has a unique, bounded, self- 

adjoint, and positive square root defined on That is, is equivalently defined by (I3.59L and it is 

1 

bounded, self-adjoint, and positive. Consequently, a unique G L{^i) exists as per (j3.37l) and (13.601) . 

with the additional properties that it is also self-adjoint and positive. 

It remains to be shown that and /C^ are boundedly invertible. To this end, note that A4^ = X~^ A~^ by 
commuting the left-hand J with I -1- ^ in the fourth equality of (13.641) . Hence, A4^ is boundedly invertible, 

as = AX^ = {X — Xfj) G C{^^) by Lemma FA.41 Also, as is positive and self-adjoint, so is 

Consequently, Ad“^ has a unique, bounded, positive, and self-adjoint square-root and fourth root, namely Ad“^ 
_ 1 . 

and = ICf^. That is, Ad^ and are boundedly invertible as required. 0 

With Lemma [3.101 in place, /C^ of (j3.59|) satisfies the properties required by definition ()3.1I) and the proof 
of Lemma F3.31 Consequently, an explicit form for the fundamental solution (13.4p may be established. 

Theorem 3.11. With as per iS. 60\) in HS.ll) . p G (0,1], and c G (c,oo), c G K.>o as per 113.5^) . the 
value funetional 1T^’° of i3.3\} takes the explicit form of IF^’'^ of \3.33]} with the operator-valued functions 

giygfi Jjy f/jg Ricszspectral operator-valued functions : [0,t'^)—>-£(.^ 1 ) of the form 

\3.44l with respective eigenvalues defined by l3.45\ l- [3.4()]) . Furthermore, the value functional W^'°° of \3.4^ 
defining the fundamental solution of the approximating optimal control problem i2.1 61) via i3.5\) is given by 


W^’°°{t,x,z) 


lim W^^'^lt,x,z) 

c—^oo 


i (a:, (t) x) 1 + (x, (t) 1 + i (z, {t) z) i , 


(3.65) 
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for all t G {d, t^), x,z G given any S G (0,t^), with 

iZf^'°° : ((5,t^)^£(jri) defined by 


OO 

it)x = Yl i > 

n—1 

X G dom{V^^’°°{t)) = JTi , 

(3.66) 

oo 

Q^’^it)z = Y,q^^^it){z, (^„)i£n, 

n—1 

z G dom{Q^'°°{t)) = 3Ui , 

(3.67) 

oo 

n—1 

z G dom{']Zf^-°°{t)) = 3Ui , 

(3.68) 


and 


^(t) = -- 


tan(a;^ t) ’ 


= +: 


sin(w^ t) ’ 




1 


tan(w^ t) 


(3.69) 


Proof. The first assertion concerning the explicit form of follows by Theorem 13.81 Lemma 13.91 and 

the specihed functional In order to prove the second assertion concerning the explicit form (13.651) of the 

limit value function of (|3.4|) . the operator-valued functions : [0, JTi) must be 

shown to converge (either strongly or uniformly) to their respective candidate limits defined by (I3.66I) " (I3.68I) . 
whereupon Theorem l3.2l can be used to complete the proof. To this end, fix /r € (0,1] and 6 S and note 

that the eigenvalues of G £(^i), given by (I3.50I1 - (I3.51I1 . satisfy (after straightforward 

calculation of the respective Taylor series expansions with respect to 1/c) 



A]((d) = 


A^(d) = 

krW-C°°WI<iA;f(d), 

A;f(d) = 


/m K 


af sin^(wf(5)’ 


1 


sin(cLif 5 ) 

Jm K 


+ 


1 


1-f 


tan(a;(‘ 6) 
1 1 
tan(a;j‘ S) sin^(a;i (5)_ 


for all n G N, t G (d, f^), c G (c, oo). Hence, (I3.44L (I3.50I) - (I3.51I) . (I3.66I) - (I3.68L (13.691) . and (IB.21) imply that 
< iA)((d), ||Q'^'^(t)-Q'^’“(t)||. < iA^(<5), ||^'^’^(t)-^'^’“(t)||i < iA(f(d), 


for all fi G (0,1], 6 G t G {S,i^), and c G (c,oo), where || ■ ||i denotes the induced operator norm 

in .^ 1 . Consequently, Lemmaand the triangle inequality imply that : (d, )—>•£(^i). 

Furthermore, the Riesz-spectral operator-valued functions : (6, converge uniformly 

to TZi^’^ : ((5,t'")^£(JC) as c-> oo. □ 

Corollary 3.12. Under the conditions of Theorem \S. 1 1[ the state feedback characterization of the optimal 
input w* of 1,9. ,9d|) corresponding to the fundamental solution (t, x, y) of |5*.^[ ) of the approximating optimal 

control problem 112.16\) is given by 


w*is) = k{s,C{s)), k{s,x) = (v>"’°°it-s)x+Qf^’°°(t-s)y'j (3.70) 

for all fi G (0,1], 5 G {0,t^), t G {6,t^), s G [0,t — (5), and x,y G where is the corresponding optimal 
trajectory generated by the open-loop dynamics i2.8\) in feedback with policy k of |9.7d[ l. 

Proof. Immediate by Theorems 13.2113.51 and 13.111 □ 

3.4. Application of the fundamental solution to solve optimal control problem ()2.16|) . The 

fundamental solution (13.41) . (|3.65|) can be applied via (13.71) and Theorems l3.1l and l3.11l to solve the approximating 
optimal control problem (12.161) for any concave terminal payoff if : —>-]R U {—oo} for which the associated 
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value function is finite. In particular, given t G x G JTi, the optimal control w* G W[0,t] that 

maximizes the payoff Jm.,ij){t,x, •) in (12.161) is given by (13.701) with y = z*, where 

z* G argmax{VF'"’°“(t,a;,0 +^>(0} • (3-71) 

2 

For the specific terminal payoff if) = z), z €. , given by m,z* = z by inspection of (13.711) . In that 

case, the value functional W^{t, ■) of (12.161) and fundamental solution W^’°°{t,-,z) of (13.41) coincide, as do their 
corresponding optimal inputs, see (13.701) . Furthermore, by substituting the series representations (I3.66L (13.671) 
for Q^’°°{t) in (13.701) . a state feedback characterization of the optimal control w* is given by 


^ E > (3.72) 


1 + A- 


for all s G [0, t — i5), where 6 G (0, t) is as per Theorem 13.Ill C(0) = x G , and z* = z G . 
Alternatively, with ip = ip^ as per (I2.22|) . v G Theorem 13.Ill and (13.711) imply that 


z* = -{ 77'"’' 


-1 r 


Q^'^{t)'x + mJJv\ =J2 — 


n—1 


\t) 


m 


“W {X, ^n)^+Y- {V, (^n) 1 


(3.73) 


where the series representation follows by substitution of (13.671) . (j3.68|) for the Riesz-spectral operators 
77'"’°° (t) respectively. (Note that existence of the inverse involved, and a representation for it, follows by 
Corollarv IB.Sn The optimal control w* is again given by (13.721) . with z* G given by (13.731) . 

Finally, it is important to note that the optimal input defined by p.70l) and (I3.7ip is not defined everywhere 
on the time interval [0, t]. In particular, by inspection of (13.651) . this input is not defined on a time interval [t—6, 7] 
containing the final time, where S G (0, t) is arbitrarily small. While this might appear to be a problematic 
limitation, it is the initial input u>*(0) that is required for the approximate solution of TPBVPs such as (II. 3|) 
via the approximating optimal control problem ()2.16|) . 

4. Approximate solution of two-point boundary value problems. For sufficiently short time hori¬ 
zons, Theorem 12.11 guarantees that stationarity of the action functional (12.121) is achieved as a maximum. In 
particular, for horizons t G [0,7'"), G K>o as per (j2.15|) . the value function 1F'"(7, •) of ()2.16l) is finite, and 
the corresponding optimal trajectory defined by (12. 8p . (I3.70L and (13.711) renders the action functional ()2.12p 
stationary in the calculus of variations sense. However, as the action principle only requires stationarity of the 
action functional with respect to trajectories, concavity of the action functional (I2.12|) may be lost for longer 
horizons. This implies a loss of concavity of the associated payoff ^ of (I2.10L and hence an infinite corre¬ 
sponding value function (12.161) . In that case, the stationary action trajectory is no longer the optimal trajectory 
defined by (|2.8I) . (13.701) . and (13.711) . so that more analysis is required. Below, the short horizon case is discussed 
first, i.e. where the stationary and maximal action coincide. An indication of an extension to longer horizons is 
provided subsequently. 

4.1. Short horizons. On shorter time horizons, i.e. those satisfying 7 G [0,7'"), the optimal trajectory 
defined by (12. 8p , (13.701) , and (13.711) is described by the characteristic equations corresponding to the Hamiltonian 
H of (13.291) for HJB (13.271) . These characteristic equations together define the abstract Cauchy problem 


f iis) 
V 


- A® 


7r(s) 


A® — 


■ 


-kA^IP A2 


dom (A®) = , 


mu 


where is the Hilbert space defined in (12.41) . Here, the augmented state is constructed from the (position) state 
^(s) G of the dynamics (12.8p driven by the optimal input w*{s) of ()3.70p . ()3.71|) . together with a transformed 

(momentum) costate 7r(s) = p{s) = w*{s) = A^ Xp, A^ (■p'‘’°°(7 — s) ^(s) -|- — s) z*) G ^ for 

all s G [0,7 — (5), z G .^ 1 , where 6 G (0,7'") is as per Theorem 13.111 and z* G is as per (13.711) . (Note that 
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1 — 1 

A'^ € £(A'i; A') hy Lemma fA.4n Meanwhile, the wave equation (11.111 defines an analogous abstract 
Cauchy problem, namely. 


f i(s) 

V p(s) 





S2m 


where ^ is the set defined in (El]). As noted in the following lemma, operators A® and A® generate respective 
semigroups of bounded linear operators defined on all time horizons. Crucially, these operators converge in an 
appropriate sense as /i —>■ 0. Furthermore, the subsequent theorem shows that the generated semigroups also 
converge, implying that any solution of the abstract Cauchy problem (12.171) converges to an analogous solution 
of the abstract Cauchy problem (I2.20|l . This naturally includes respective trajectories corresponding to the 
approximate and exact solution of TPBVPs such as m- 

Lemma 4.1. Given fi G (0,1], the operators A® and A® of [2AT\) and i2.20\) satisfy the following properties: 
(i) A® G 

(li) A® generates a uniformly continuous semigroup of bounded linear operators T®{t) G t G K>o; 

(Hi) A® is unbounded, closed, and densely defined on (with 

(iv) A® generates a strongly continuous semigroup of bounded linear operators T®{t) G ), t G M>o; 

(v) A® converges strongly to A® as ^ 0, i.e. lim^_>.o ||M® y — A® ?/||© = 0 for all y € 

Proof, (i) Fix any y = ( ^ j G Applying definitions (12.41) and (12.171) of || • H© and A®, 


Wy\\l = 


— Xfir 

m 

-kA^I^AU 


+ K 


A^Xl 


Xjf A^ f 


A^Xl 


^2 X^ TT 




A^Xl{A--0 


where M = ( —) 2 


A^Xl 


< 00 by assertion (IA.16I) of Lemma IA.4[ as required. 


(ii) Immediate hy (i) and [T9| Theorem 1.2, p.2]. 

(Hi) and (iv) Follows by an analogous argument to [3] Example 2.2.5, p.34]. 


(v) Fix any y = 


G dom (A®) = (% = © JTi. Recalling (12.41) . (|2.17|) and (I2.20L 


\A®y- A®y\\ 


0 

-kA^xI 


1 n-2 
™ -i-'Ll 


0 A© 

m 

-kA 0 


lAi {X^ -X)A^ 


^\\{xi -x)7:\\i + ^wah^I -i)AHr = iim Trf+-x)Afr, 

(4.1) 


where the last equality follows by definition of || • ||i and assertion (IA.15I) of Lemma fA.4l Note further that 

1 1 

A 2 TT, G by definition of y G Consequently, it remains to be shown that X)! converges strongly 

1 . 

to I on as y —^ 0. To this end, fix any x G and note that ||Ax|| < 00 . Note also that Xjf — I is a 

1 

Riesz-spectral operator on 32, with dom {Xjf —X) = 32, so that 


(X^ -X)x 


2 


I(a;, V5r^)|^ 

n—1 


(4.2) 


where fdx ■ R>o“^[0,1) is defined for each A G M>o by I3x{e) = [1 — 


%/T+7aJ 


^ Taylor’s theorem implies that for any 


e G 


&>o, there exists an Ce G (0, e) such that Px{e) = [^^(cc)] V ^ \ | (1 + A) 2 + 2 (1 + A) 


'i-a 


< 
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I for all A G K>o- Substitution in (14.21) yields that ||(I^ — I)x|p < j ^n)\^ = 

I ||Alx||^. Recalling that x G so that ||Alx|| < oo, it follows immediately that lim^_>o \\iX^ —X)x\\ = 0 
1 . 

for any x G As G C{^) by Lemma fA.dl and is dense in ^, it may also be concluded that 

1 

lim^_j.o 11(1^ — X)x|| = 0 for any x € ^. Applying this fact in (14.11) completes the proof. □ 

Theorem 4.2. T®(t) converges strongly to 'T®(t) as ^ ^ 0, uniformly for t G K.>o in compact intervals. 
In particular, lim„_>o |7TP(t) y — T®(t) j/|L = 0 for all y G '31, t G It, fl C. K>o compact. 

Proof. The proof follows by application of the First Trotter-Kato Approximation Theorem (see for example 
[9l Theorem 4.8, p.209]), via Lemma [4.II □ 

With the convergence property of all solutions of (12.171) and (12.201) provided by Theorem 14.21 and formu¬ 
lae (I3.70L (13.711) for the optimal input that generates the corresponding optimal trajectory that renders the 
approximate action functional stationary, a recipe for approximating the solution of TPBVPs such as m on 
short time horizons may be enumerated. 

Recipe for the approximate solution of TPBVPs for horizons t G (0,t^) 

O Select the approximation parameter fi G (0,1], and a truncation order V G N for the Riesz- 
spectral operator representations. 

© Fix t G (0,^^“), where G M>o is as per (12.151) . 

© Select a terminal payoff ip '■ —tKU {—oo} that encapsulates the terminal condition of interest, 

e.g. (I2.22L and apply (I3.71I) via the fundamental solution (I3.65I) to determine the corresponding 
terminal state z* G see for example (I3.73I) . 

0 Truncate the Riesz-spectral operator representation for the optimal input r(;*(0) of (I3.70|) . with 


w*{0) = k{0,x) = Ai X + &’^(t) z*) 


N 


W 


(0) = E 




1 + Ar 


{x, (pn)^ + q'^'°°{t) {z*, i) , 


where pf'°°{t) and qff'°^(t) are as per (I3.69p . 

© Propagate the solution of the wave equation (HU using ||(0,.) = d;*(0). 


With particular reference to step 0 in the case where a fixed final velocity v G is specified via if = ipv 
as per (12.221) , substitution of the left-hand equality of (13.731) in (13.701) yields the required initial velocity as 


‘{0) = Aa-^I,A-^ 


_ QM.OO ^ ^ ^ QM.OO ^ J J 


(4.3) 


A series form for w*{0) follows by substitution of the Riesz-spectral operator representations for 7^^’“(t), 
Q/i,oo(^), and J into (|4.3p . with the details omitted for brevity. 

4.2. Longer horizons. As noted previously, the correspondence between stationary action and optimal 
control exploited for shorter horizons via (12.161) may break down for longer time horizons due to loss of concavity 
of the associated payoff (12.101) . see Theorem 12.11 Consequently, for longer time horizons, a modified approach 
is required. Two such approaches have been developed for finite dimensional problems, see [la ng, based 
on replacing the supremum in the definition (12.161) of the associated optimal control problem with a stat 
operation. This stat operation yields the stationary payoff (and hence the stationary action functional) without 
assuming that it is achieved at a maximum. In particular, in longer time horizons are accumulated via the 
concatenation of sufficiently many sufficiently short time horizons, with the stat operation used to characterize 
the intermediate states joining adjacent short time horizons. More generally, the supremum over inputs in 
(12.161) may be completely replaced with the stat operation, see [18) . Using either approach here requires a 
corresponding extension to infinite dimensions. For brevity, such an extension is postponed to later work. 
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Instead, for the purpose of presenting an illustrative example in Section [Sj an outline of the development of the 
former (concatenation) approach is provided, in a formal setting only. This outline is as follows. 

Given a fixed longer time horizon t G {t^,oo) of interest, select a sufficiently large number nj £ N of shorter 
horizons r = t/nt such that r £ (0,t^). By definition of r. Theorem 12.11 implies that the payoff 
defined by (I2.10p . and hence the action functional of (12.1211 . is concave for any x £ That is, the action 
functional is concave on each of the subintervals [{k — 1)t, fcr], k £ [l,nt] (~l N, with any loss of concavity 
occurring in the dependence on the intermediate states Cfc = ^{kr) £ 

Motivated by this observation, a correspondence between stationary action and optimal control can be 
established for longer horizons for finite dimensional problems by relaxing the supremum in the associated 
optimal control problem, see m- In the infinite dimensional case considered here, it is conjectured that the 
fundamental solution •, •) of the approximating optimal control problem defined by (12.161) . as appearing 

in (13.Sp . is defined on longer time horizons by 




stat 


nt 

j2w^’^{T,Ck-i,Ck) 


Co — X, Crit 



(4.4) 


for all X, z G 3^^ , in which the stat operation is defined generally by 


stat F(x) = 

xeSTi 



X £ argstat F{x) 




arg statF(x) 


£ JTi 


0 = lim 


\F{y) - f(x)| 

\\y-x\\i 


for functional F : .(2^—j-R. Figure ST] provides an illustration of the role of the intermediate states Cfe G 
k G [l,nt] n N. (Note that replacing stat with sup in (14.41) recovers the original short horizon fundamental 
solution (13.4p as per (13.51) . albeit applied to the longer horizon.) 


X = Co 




CK r) 


Fig. 4.1. Concatenations of trajectories to yield a longer time horizon. 


In order to test the conjecture that (14.41) is a suitable generalization of the longer horizon fundamental 
solution, recall that •, •) takes the form of the quadratic functional given by (13.651) . see Theorem 13.Ill 

Combining (13.651) and (14.41) . 


(;)), " 

where (•, •)* denotes an inner product on (S'i)”*+^, defined for all C: C ^ by (C,C)* = Fril^(C£ Ci)ij 

and n'^(T) £ (/:(jri))(”‘+bxK+i) is a matrix of Riesz-spectral operators defined by 




0 

0 

0 




0 

0 

0 


P^^’°°(T) + n^^'°°{T) 

0 

0 

0 

0 

QA‘.°°(r)' 

0 

0 

0 

0 

0 

gM.oo(^) 

0 

0 

0 

0 

... 

Q^’°°(t) 

0 

0 

0 

QM.oo(^y 

(t) 
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W^^’°°it,x,z) = stat 


0'"(T,a;,C,z), Q>^{t,x,C.z) = 



, n'^(r) 

























(4.6) 


F’°°(t) 

F.2(^) 

0 

K2iry 


FsK^) 

0 

F3(^)' 

7 ^M,oo(t) 


The existence of a solution of a TPBVP such as dm on the long horizon t G M>o requires (by the action 
principle) that the stat in the definition (14.51) of exist. Define C* S (^ 1 )”*“^ by 


= argstat 


and note that 0 = V^0'^(t, x, z), where V^0'^(t, x, z) G (.^1 )”* ^ is the Frechet derivative of x, ■, z) 
at C G (^ 1 )"*“^. Applying (14.61) yields 


n^,2(^) C^’* = -n)‘,2(r)' x - nl,{T) z. (4.7) 

Hence, on the longer horizon t G [t^,21^) (for example), the fundamental solution (13.41) generalizes as per (14. 4|) 
to W^'°°{t,xX^’*) + ,z), where C,^’* solves (14.71) for rit = 2, t = f/2. This approach generalizes 

to any fixed longer horizon t G K> 0 ) and taking /r —t 0 corresponds to sending n* —t c» in (14.41) . Furthermore, 
in this limit, it may be shown that evaluating dUl) via (USD and (IVfl) yields the same explicit quadratic 
representation for the fundamental solution W^’°°{t,x, z), but with /r = 0, as presented in Theorem 13.Ill 

5. Example. For sufficiently short time horizons, as considered in Section 031 the action principle cor¬ 
responding to the wave equation (11.11) may be approximated by the optimal control problem (12.161) . This 
approximation may be extended to longer horizons via the concatenation approach outlined in Section 031 and 
becomes exact in the limit of the perturbation parameter /i G R tending to zero (see Theorem l4.2l) . Consequently, 
as the action principle describes all possible solutions to the wave equation dm, including those constrained 
by any specific combination of boundary data, TPBVPs involving this wave equation may be solved via the 
optimal control problem (12.161) . The initial velocity w*{0) that solves such a TPBVP may be found via the 
recipe enumerated in Section [4. 11 with /r = 0. In particular, step © of that recipe yields the initial velocity that 
solves a TPBVP as 


V = w*{0) 


A Ai lo A^ V,TF°’“(t, x,z) = Aa x + z* 


^ E {z*, 

n—1 




(5.1) 


where as per (j3.69|) and z* is as per (I3.71L after sending /r —>• 0. 

With m = K = L = 1 (with appropriate dimensions) in (11.11) . suppose that the specific problem TPBVP(t, x, z) 
is to be solved given the (arbitrary) initial displacement a; = 0 G terminal displacement z G as per 
Figure ISTlT a'). and horizon t = ^ (^)^ (~ 1-05). Recall in that case that the terminal payoff ip = ip^’°°{-,z) 
encapsulates the required terminal displacement, and z* = z is required in dEID, as per discussion following 
(13.711) . Applying (15.11) then yields the required initial velocity illustrated in Figure ISdT bl that solves TPBVP 
m via the fundamental solution dSH). This solution may be tested by propagating the initial displacement 
and velocity obtained forward to time t by solving the wave equation directly. (Here, the Co-semigroup 
T®(-) of (j2.21l) generated by .4® is applied to this end, see for example [3].) The resulting wave equation 
dynamics are illustrated in Figure with the desired terminal displacement clearly achieved. Integration 

over a longer time period reveals (expected) periodic behaviour, see Figure [53Kb). 

6. Conclusion. A new fundamental solution based approach to solving a two point boundary value prob¬ 
lem for a wave equation is considered. A value functional based characterization of this fundamental solution is 
formulated via the analysis of an optimal control problem that encapsulates the principle of stationary action. 
This value functional is shown to enjoy an explicit Riesz-spectral operator based representation via an associ¬ 
ated infinite dimensional Hamilton Jacobi Bellman partial differential equation. Application of the fundamental 
solution obtained is illustrated via a simple example. 
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(a) Terminal displacement ^(A) vs A. (b) Initial velocity r’(A) vs A. 

Fig. 5.1. Initial velocity reauired to achieve terminal displacement. 



(a) Wave equation solution u{s.,X), s G [0,t], A € [0,Z/]. (b) Wave equation solution u(s, A), s E [ 0 , 4 L(^) 2 ], A E [0,1/]. 

Fig. 5.2. Solutions of wave equation HTTP . 
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Appendix A. Properties of operators A and . Operators A and A^ are key to the application of 
the principle of stationary action to obtain the wave dynamics via optimal control. The relevant properties 
of these operators are largely well-known [3] , and are stated without proof unless otherwise indicated. 

Lemma A.l. The following properties hold on ST : 

(i) Operator A is self-adjoint, positive, houndedly invertible, and closed, with 

A! X = Ax, VxG dom {A!) = dom (A) = , 

ran (A) = ran (A') = ^ , 

{x, Ax) = lldcclp > 0, V X G dom (A) = , x 0, 

a-'.=Ia{;oho<k. oic^Aii 

V X G dom (A“^) = , 

ran (A~^) = dom (A) = . 


(A.1) 

(A.2) 


(A.3) 


(ii) Operator A has a unique, positive, self-adjoint, boundedly invertible, and closed square root A^, with 


A^ X G dom (A^ ) = 

A5 A^ X = Ax, 

||A^x|| = ||dx|| = ||x||i 

J X = (a^) X = (A“^) ^ X, 

IU^IIi = INI, 


V X 

G dom (A) = 

, 

(A.4) 

V X 

G dom (A) = 


(A.5) 

V X 

G dom (A) = 

^0, 

(A.6) 

V X 

G dom{J) = 

JT, 


ran 

{J) = dom (A^ ) = Sji , 

(A.7) 

V X 

G dom {J) = 

3T. 

(A.8) 


Lemma A.2. Operator A of i2.2\} has countably infinite simple eigenvalues given by where 

eigenvalue A„ corresponds to eigenvector ipn € B of i2.6\} (or equivalently (pn G B) and 




(A.9) 


Similarly, the square root A^ of operator A has countably infinite simple eigenvalues given by where 

eigenvalue corresponds to eigenvector ipn G B (or equivalently in <pn ^ B) and A„ is as per < fd.,9l) . 

Lemma A.3. B and B of \2. 6\) are orthonormal Riesz bases for and respectively. 

Lemma A.4. The following properties hold on 3T for any p G K>o- 
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(i) Operator of \3.26\) is bounded, linear, self-adjoint, positive, with 


If_iX £ dom (^) = ^0 
If,x= f If,{-,C)x{C)d(, 


y X £ dom {Ty) = Sf , 


4(A,C) = 


1 


M sinh(^) 


M X £ dom {Tfi) = ^. 


sinh(A) sinh(^), 

sinh(^) sinh(^^), 


(A.IO) 

0 < A < C < A, 

0 < C < A < L, 

(A.ll) 


1 , 

(a) Operator has a unique, bounded, linear, self-adjoint, and positive square root If, with 

If X £ dom (A ^) = y X £ dom {If ) = X , (A.12) 

Iflfx = lfj,x y X £ dom {If ) = dom {I^) = , (A.13) 

1 1 

(Hi) Operators I^, If, A, and A'^ commute, with 

If A^ X = A^ If X, Ifj, A^ X = A^ IfiX y X £ dom {A ^) = . (A.14) 

If^Ax = AIi_iX, If Ax = Alf X y X £ dom {A) = , (A.15) 

1 1 

(iv) Selected compositions of operators I^, If, A, and A^ define bounded linear operators, with 

AI^, A^ If £ C{31), (A.16) 

AI^£C{SIi), (A.17) 

A^If A^ £L{S:i_,3I). (A.18) 


Proof (i) Fix any x £ dom (^) = Consequently, Ax £ S', and 

(x, {I + A) x) = ||a:|p + pf (x, Ax) > ||x|p , 


where the inequality follows by positivity of A, see assertion (IA.2I) of Lemma lA.ll That is, I -\- A is 
both positive and coercive [21 Definition A.3.71, p.606]. It is also self-adjoint by (lA.ll) . Hence, I -I- ^ is 
boundedly invertible, see for example [21 Example A.4.2, p.609] and [121 Problem 10, p.535]. In particular, 
I^ = {I -\- pf A)~^ £ £{S'). In order to show that is also self-adjoint and positive (but not coercive), 
fix any y, rj £ Sf, and define x, f by x = I^y and f = I^p. As I -\- p^ A \s self-adjoint, {y, I^ rf) = 

{{I-\-p^ A) X, f) = (x, {I-\-p‘^ A) f) = {Ifj, y, p). Asy, p £ S' are arbitrary, it follows that is also self-adjoint. 
Furthermore, with y = p, (y, Ifi y) = {{I-i-p^ A) x, x) > ||x|p = ||I^ yp. As is invertible, the right-hand side 
is zero if and only if y = 0. Hence, I^ is positive. However, is not coercive, as it has eigenvalues arbitrarily 
close to zero. For example, select y = tpm with ifn is as per (1^ . Note that HV'nll = 1- Applying Lemma 
IA.21 it is straightforward to show that (V'n, X^ ^„) = \ . ||V'n||^ = , , ll'0n||^ for all n S N. Note in 

ri l + fL \ ) 

particular that the coefficient on the right-hand side may be made arbitrarily small for sufficiently large n G N. 
Hence, X^ cannot be coercive. 

It remains to be shown that (|A.10I) and (lA.llI) hold. Fix any x £ S'. By noting that I — I^ £ C{S), the 
definition (|3.26|) of X^ implies that 

oo > ^ ||(X-X^)x|| = ^||([X + yM]X^ -X^)x|| = MX^x|| . (A.19) 

Hence, I^x £ dom {A) = Sq for any x G S, so that (lA.lOl) holds. Given the kernel If_i as defined in (lA.llI) . 
define the operator X^ by 


Ifj.x= [ Ifi{-,0x{0d(, dom(X^) = jr, 

Ja 
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(A.20) 

























and note that € £(^) by inspection. Fix any x € ^ and define y = I^x G M'q. Hence, Ay G ^ and 
%Ay = Xv4(-,C) [-d^y{C)]dC = - JA[dilti{-,C)]y{OdC, where 9|4(A,C) = C) is the 

second weak derivative of •), A G A fixed. Note in particular that the boundary conditions y{0) = 0 = y{L) 
have been used here. Consequently, If, Ay = “ H' “ C)]2/(C)<^C = - y), so that 

If, {I + fA A) y = y. Recalling the definition of y, it follows immediately that Xf,x — Xf,x. As x G ^ is 
arbitrary, assertion (lA.llI) follows. 

1 

(a) The existence of a unique, bounded linear, self-adjoint, and positive square root X^ follows (for example) 

by Theorem 4]. (Alternatively, see [31 Lemma A.3.73, p.606].) 

1 1 

(Hi) Fix X G 3^1. By definition, A"^ x G SX = dom (I^?), and 

Xf,A^x={X^ A)-^ A^x = {J[X + A])-^ x = {J + J A^ ^5)-i a; 

= {J + y^ A^ A'^ J)~^ x = {\X + y^ A\ J)~^ X = A^ {X + y"^ - 4 )“^ x = A^ Xf,x , 

so that right-hand equality in assertion (IA.14|) holds. The remaining equalities follow similarly, with x G 
yielding assertion (IA.15|) . 

(iv) The first assertion in (|A.16|) follows from the proof of (i) above. In particular, X — Xf, G £{i^) and 
(IA.19|) imply that ||AH^|| = ||I —1^|| < oo, as required. In order to prove the second assertion of (|A.16|) . 

note that for any x G >^i, (IA.I5P implies that 

x|p = {x, X^ AX^ x) = {x, AXf,x) < ||x|| ||AlI^x|| < ||AlI^||||x|p . 


Hence, the restriction TZf, oi A'^X(i, : to the domain C is bounded and linear on that domain. 

However, as Xi. = , 'R.f, can be uniquely extended to an operator Sf, G £{J^) (see for example [131 Theorem 

I 1 

2.7-11, p.lOO]) that satisfies £f,x = TZf,x = A^X^ x for all x G Fix y G . Hence, for any x G 
\\£f,y-A^X^y\\ < \\£f,x - A^X^ x\\ + \\{£f,-A^X'^){y - x)\\ < \\£f, - A^ X^\\\\y - x\\. Consequently, as 

_ I 1 I 1 

X G JA is arbitrary and implies that \\£fj,y — A^ X^ y\\ < \\£f, — A^ X^ || \\y — x|| = 0. As 

2 2 2 
^ 1 

y G ^ is arbitrary, £f, = A'^X^. Recalling that £f, G £(S£) completes the proof of assertion (IA.16F 

In order to prove assertion (IA.17I) . note that Ax and Xf, commute on by (IA.14I) . Hence, with x G . 
||AlI^x|| 1 = 11^^ Xf,A^ x\\i = \\AXf, {A^ x)|| < llAlI^II \\A^ x\\ = \\AXf,\\ ||x|| i. As AXf, G £( JT) by (IA.16D , 
assertion (|A.17p immediately follows. 

ill 1 i 1 

Finally, in order to prove assertion (lA.lSp . note that (IA.16I) implies that ||Al 2 X^ A^ x|| < ||Al 2 Xj} || \\A^ x|| = 

1 1 ^ 

Ikll 1 for any x G Consequently, sup,^g^^ ||,^|| ^ """ ^ < oo as required. □ 

"S’ ■2’ 2 

Appendix B. Riesz-spectral operators. It is useful to consider self-adjoint operators of the form 


OO 

Tx = '^f^(x, ipn) 1 (pn , 

n—1 


dom (.F) = 


|x G .^1 


.Fx G JA 
2 


(B.l) 


where the set {fn}neN C K of eigenvalues of if is simple and has a totally disconnected closure (i.e. no two 
elements of this closure can be joined by a segment lying entirely within it), and B = {(,5n}rteN (enumerating 
the corresponding eigenvectors of .F) is the orthonormal Riesz basis defined by (12.61) . This type of operator is 
closed and densely defined on see [31 Example 2.1.13, p.29], and is referred to as a Riesz-spectral operator 

on see [S] Definition 2.3.4, p.4I]. Operators A and A^ are Riesz-spectral operators, and may be similarly 
represented, see [31 Theorem 2.3.5] and Lemma FB.61 below. The identity X also takes the form (IB.II) . with 


OO 

X=Xx = ^(X, ipn)i Ifin , 

n—1 


(B.2) 


27 


dom (F) = . 


































However, X is not a Riesz-spectral operator (its eigenvalues are repeated at 1, and so are not simple). Never¬ 
theless, ||x||l = ^ see [21 Corollary 2.3.3, p.40]. 

The remainder of this appendix documents some useful properties of Riesz-spectral operators that are 
applied in the main body of the paper. Unless otherwise indicated, proofs of these properties are considered 
standard and are omitted. 

Lemma B.l. The domain dom{iF) of a Riesz-spectral operator iF of the form HB. 1\) is equivalently given by 


dom (F) = |x G iFi 


\\F x|| 1 < oo 


}. 


n—1 


(B.3) 


Lemma B.2. LetF andQ denote two Riesz-spectral operators of the form with respective point spectra 

cfp{F) = {fn^fFi andap(Q) = {gn}'F=iy domains dom{F), dom{Q) as per (B.3\) . Suppose additionally that 
{fn gn}'F=i simple, and its closure is totally disconnected. Then, the composition FQ is also a Riesz-spectral 
operator of the form (B.ll) . with 


OO ^ 

F Q X = '^ fn gn {x, fin) 1 Tn , dom [F Q) = lx ^ dom (0) c STi 

'n = -\ ^ 


G X G dom (F) > . 


(B.4) 


Corollary B.3. Let F and G he Riesz-spectral operators as per Lemma \B.B . Then, the domain of the 
composition F G of jB.fD is equivalently given by 


dom {FG) = lx G Ffi 


I(a;, < OO I . 


(B.5) 


n—1 


If additionally there exists /_ G K>o such that \fn\ > f- for all n G N, then the domain dom{FG) specified via 
or HB. 5\) is equivalently given by 


dom [F G) = I X G iFi 


X l/"5nP l(a;, < OO I . 


(B.6) 


n—1 


Proof Recalling (IB.41) . x G dom (.U^) if and only if x G dom (5) and Gx G dom (/■). These respective 
properties hold if and only if 


00 > X OO > X = X 


(B.l) 


So, the domain of .F ^ is given by 


dom (F" ^) = < X G dom {G) C iFi 


G X G dom (F) > = < X G dom {G) C iFi 


X |(x, < OO 


n=l 


= < X G Fli 


X(^ + p < OO L 


n—1 


as specified by (IB.51) . Suppose additionally that there exists /_ G M>o such that \fn\ > /_ for all n G N. 
Define the domain candidate ^ as per (IB.61) . that is ^ = ja: G JT I l/n5nP \{x, fn)^\^ < ooj. Fix any 

X G dom [FG) via (IB.5|) . By inspection, it immediately follows that x G Ft. That is, dom {FG) C F. In order 
to prove the opposite direction, fix any x G F, and note that the second inequality in (IB.71) implies the first. In 
particular. 


00 > 'y ( Ifndnl |(x, fn)l\ > /- ^ ^ |<7ra| |(x, fn) 1 


/-eK>o 


OO > ^ (B.8) 
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which implies that OO > J2u=l \fngn\^\{x, <Pn) +J2u=l \9n? |(a;, = Er=i(l + I/»P) \9n? I(a;, (pn)i\^- 

Consequently, x G ^ implies that x G dom {T Q), or ^ C dom {T Q). Combining this with the earlier conclusion 
that ^ D dom Q) yields that S’ = dom {T Q). That is, (IB.61) holds as required. □ 

Lemma B.4. Let P , denote a pair of Riesz-spectral operators of the form m \>, with point spectra 
0 ^ ap[F) = {fn}T=i o-nd <Xp{P) = {;^}“=i- Then, 

JF P X = X, \/xGdom{P), pFx = x, \/xGdom{p. (B.9) 


Corollary B.5. A Riesz operator T on with point spectrum satisfying 0 ^ cfp{p = {fn}'^=i is 
invertible. Furthermore, its inverse is also a Riesz-spectral operator on dFi, and is given by 


OO 

X = '^-^{x, dom{Fp 

n—1 


G 3Fi 


XI < OO 


n—1 


(B.IO) 


It is well known by Riesz’s Lemma that the identity X of (jB.2ll is not a Riesz-spectral operator on 

Consequently, the composition of a Riesz-spectral operator F and its inverse F~^ (also a Riesz-spectral operator, 
by Corollary EH) is not itself a Riesz-spectral operator. Indeed, in attempting to apply Lemma IB.21 to such 
a composition FF~^ reveals that its point spectrum UpipF~^) = {1} is not simple, thereby violating the 
definition of a Riesz-spectral operator. 

1 i —i 1 1 1 

Lemma B.6. , ff, X^^, Xp , Xp ^ , and .A^ Tp are Riesz-spectral operators of the form mi on 

i _ i 1 1 

^ and Sfi, with respective eigenvalues given by Xn, Xf, A„ ^, (I -I- (1 -I- A„) 2 , {1 -\- p Xn)~^, and 

A„ (1 -I- p Xn)~^ for all n gN, where A„ is as per IIA.9[) . 

Proof Operator A is closed and linear on with simple eigenvalues crp(Al) = {A„}^;^ C R defined by 
(IA.9I) and corresponding to eigenvectors B = pPPi C SX a,s per (12.61) . The closure of the point spectrum of 
A, denoted by ap{A), is totally disconnected, and B forms a Riesz basis for , see Lemmas lA.11 IA.21 and lA.31 
Hence, operator Al is a Riesz-spectral operator on (see also[3l Definition 2.3.4, p.41]), and operator Al and 
its domain dom (Al) = may be represented as per (IB.II) with the aforementioned eigenvalues. An analogous 
argument for Al defined in with eigenvectors B as per (12.6p corresponding to the same eigenvalues {A„}„gN 
and forming a Riesz basis for , yields that Al is also a Riesz-spectral operator on dFi. A similar argument 

yields that Al^ is a Riesz-spectral operator on SX and SXi. As Al^ J = X, Corollary IB. 51 implies that J is 
similarly a Riesz-spectral operator on and SXi. 

In order to show that the remaining operators are Riesz-spectral operators, first note that Xp =X -\- p A 

defined via p.26p is a Riesz-spectral operator, with eigenvalues {1 -I- A„}„gN- This follows by (IB.21) and the 

fact that Al is a Riesz-spectral operator. Consequently, Corollary IB. 5 1 implies that Xp is also a Riesz-spectral 

1 

operator. Lemma IA.4I states that Xp has a unique square-root Xp . Subsequently applying Lemma IB.21 and 

1 _1 

Corollary IB. 51 implies that both Xp and Xp ^ are Riesz-spectral operators. The fact that the composition 
A^ Xp A^ is a Riesz-spectral operator follows by two further applications of Lemma EH □ 

Appendix C. Riesz-spectral operator-valued functions. A Riesz-spectral operator-valued function 
takes the form 


F{t)x = X fn{t) {x, (^„)i ipn , dom {F{t)) = 

n—1 

where t G Ll, (pn G B \s as per (1^ . and fn ■ fl—>■]&, for all n G N, for some interval D C R>o- 

Lemma C.l. Suppose that the Riesz-spectral operator-valued function F defined by IIC.1\) satisfies the 
following properties with respect to a bounded open interval LI C R.>o- 
('^) {fn(t)}nen C R is a strictly monotone sequence for every t G ft; 

(ii) fn G (7^(12; R) for all n G N; and 


G SFi 


F{t)x G tFi 


(C.l) 
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(Hi) there exists an Mf G ]R>o such that max(|/ji(i)|, \fn{t)\, \fnit)\) < Mf for all n € N and t € fl. 

Then, T{t) G £(^i) for all t € fl, and T : il —is Frechet differentiable with derivative T : ?>£(^i) 

of the form iC.ll) given for all t G fl and x G <^i by 


OO 

^{t)x= ^ fnit) {X, (^n)i ifn ■ 
n—1 


(C.2) 


Proof Fix t G and x G x 0. By property (i), as {fn{t)}n&n C R is a strictly monotone sequence, 
its closure is the union of itself and its supremum or infemum, where the latter is strictly less than or strictly 
greater than every elem ent of {/ 7 i( t)| 7 igw- Hence, there always exists at least one open interval between any 
two distinct elements of {fn{t)}neti^ so that any two such elements cannot be joined by a segment lying entirely 
within {/rt(t)}nGN- That is, {fn{t)}neti is totally disconnected. As B = {<^n}nGN is an orthonormal Riesz basis 
for it follows by O Corollary 2.3.6, p.45] that F{t) is a Riesz-spectral operator. Applying (IB.31) to F{t), 
and applying property (Hi) and (IB.21) . yields that 

OO OO 

\\J^{t)x\\l < |/m(t)P I(a:, <Mj Y l(*> ‘?rn)ip = M] ||a;||| , (C.3) 

m—1 m—l 


or F{t) G with ||J^(t)|| < Mf. Define D(t) = {g g M>o | s + < G D}, and fix e G D(t), e 0. Define F 

as per (1C.21) . and note by property (Hi) and (1C.31) that iF{t) G with ||.F(t)||i < Mf, where || • || i here 

denotes the induced operator norm on iFi. Applying property (ii), fn{t + e) = fnit) + e fnit) + (^) fnix) for 
some T G it,t + e), so that 


[Fit + e) - Fit) - eFit)]x ^ ^ |/„(t + e) -/„(t) - e|(a;, 




Consequently, dividing through by e ^ 0 and ||a;|| i ^ 0, 


lim 

e-fO 


Fit + e) - Fit) 


eFit) 


= lim 

e—>-0 I 


[Fit + e) - Fit) - eFit)]x 


sup ■ 

j^ll 1/o 


< lim Mf = 0 , 

— £_s.n ^ ’ 


in which the left-hand norm is again the induced operator norm on fPi , thereby demonstrating that F is indeed 
the Frechet derivative of F. □ 
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